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We show that the stochastic dynamics of a large class of one-dimensional interact- 
ing particle systems may be presented by integrable quantum spin Hamiltonians. 
Using the Bethe ansatz and similarity transformations this yields new exact re- 
sults. In a complementary approach we generalize previous work|l], and present 
a new description of these and other processes and the related quantum chains 
in terms of an operator algebra with quadratic relations. The full solution of the 
master equation of the process is thus turned into the problem of finding represen- 
tations of this algebra. We find a two-dimensional time-dependent representation 
of the algebra for the symmetric exclusion process with open boundary conditions. 
We obtain new results on the dynamics of this system and on the eigenvectors 
and eigenvalues of the corresponding quantum spin chain, which is the isotropic 
Heisenberg ferromagnet with non-diagonal boundary fields. 



1 Invited lecture given at the Satellite Meeting to Statphys 19 on Statistical Models, 
Yang-Baxter Equation and Related Topics, at Nankai University, Tianjin (August 1995). 
To appear in the Proceedings, eds. F.Y. Wu and M.L. Ge, (World Scientific, Singapore) 



1 Stochastic Dynamics and Quantum Systems 



A convenient and much used description of stochastic processes is in terms of 
a master equation for the probability distribution of the stochastic variables 
of the system. A master equation expresses the probability of finding the 
system at time t + At in a given configuration in terms of the probability 
distribution at time t through a first order differential equation in the time 
variable (infinitesimal At) or through a difference equation in t (for discrete 
time steps At). Such processes are Markov processes which may be con- 
structed for the description of e.g. interacting particle systems ||. These 
systems are of interest because they have turned out to be useful as models for 
react ion- diffusion systems in physics and chemistry ||J] and, through various 
mappings, as models for spin flip dynamics ||, interface growth ||, dynamics 
of DNA in gels [7| and many other highly interesting and non-trivial systems. 
Even in relatively simple models one finds a very rich dynamical behaviour 
involving dynamical and non-equilibrium phase transitions of various kinds. 
A particularly well-studied model where this happens is the asymmetric ex- 
clusion process in one dimension [J7[|. This model is a discrete version of the 
noisy Burgers equation and describes not only driven diffusion of hard-core 
particles, but is also a model for dynamics of driven interfaces, polymers in 
random media || and the kinetics of biopolymerization || . 

It is well-known that a master equation can be expressed in a "quantum 
Hamiltonian formalism" by mapping each state of the system to a basis vector 
in a suitable vector space X. In this mapping the probability distribution at 
time t becomes a vector | f(t) ) and the master equation takes the form 

§;\f(t)) = -H\f(t)) (1) 

where if is a suitably chosen linear map acting on X.0 This is in formal 
analogy to second quantization in quantum mechanics and we will therefore, 
in slight abuse of language, call H a quantum Hamiltonian. The ground 
state of this in general non-hermitian Hamiltonian (which by construction 
has energy 0) corresponds to the stationary probability distribution of the 
stochastic dynamics. 

This mapping is in itself not a great achievement, since it represents only a 
change of language. However, it has turned out in recent years that for many 

2 For discrete time dynamics the corresponding equation reads f(t + 1) ) = T\ f(t)). 
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interesting models the quantum Hamiltonian obtained in this way is an object 
well-known from other areas of physics and tractable with techniques largely 
unknown to the community of people interested in the original problem of the 
stochastic dynamics. A paradigmatic example of this kind is the symmetric 
exclusion process ||. In this model particles on a lattice hop between lattice 
sites k, I with rates p(k, I) = p(l, k). They interact via a hard-core repulsion 
which prevents the occupation of a lattice site by more than one particle. 
The quantum Hamiltonian obtained for this system through the mapping 
described above is the Hamiltonian for the isotropic spin 1/2 Heisenberg 
ferromagnet ||10||. Here the SU(2) symmetry of the problem (which is not 



obvious at all in the original master equation) and other approaches have been 
used for obtaining new exact results JTT], [TIJ. Moreover, in one dimension, 
the system with nearest neighbour hopping is integrable and can be solved 
by the Bethe ansatz. 

As will be shown below, the integrability is not a special feature of the 
symmetric diffusion process alone. Also the more interesting and much more 
challenging case of asymmetric diffusion in one dimension is described by 
an integrable quantum Hamiltonian and, using the Bethe ansatz and related 



methods many new exact results have been obtained [IT, 13, 14, 15]. More- 
over, it turns out that a 10-parameter class of reaction-diffusion systems of 
identical particles [lJJ and react ion- diffusion systems of non-identical particles 
|fL7| , |i~8|1 are described by integrable quantum chains.^ 

Independently from these developments a new approach for the treat- 
ment of one- dimensional systems was introduced by a matrix description of 
the ground states of spin Hamiltonians |^TJ and then of the stationary distri- 
bution of the asymmetric exclusion process with open boundary conditions 



2^, |23], £4J]. In this approach the ground state vector of the quantum Hamil- 
tonian (i.e. the stationary distribution of the stochastic process) is expressed 
in terms of a matrix product measure and given by certain matrix elements 
of matrices which are representations of an algebra determined from the dy- 
namics (i.e. the Hamiltonian) of the system (see below). Going further, a 
time-dependent matrix ansatz was introduced for the description of the com- 
plete dynamics of the (a) symmetric exclusion process with open boundary 
conditions [0] and used for the derivation of the spectrum in the symmetric 

3 For discrete-time dynamics with parallel sublattice updating one gets as time evolution 
operator T the transfer matrices of integrable vertex models fl9|, |20|] . 
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case|2j]. While for the calculation of correlation functions one needs a repre- 
sentation of the dynamical algebra, for the derivation of the spectrum alone 
the algebra itself is sufficient. In general, the spectrum contains already valu- 
able information about the decay of correlations to their stationary values: 
If the Hamiltonian has an energy gap, the decay will, at late times, be expo- 
nential, while for a continous gapless spectrum one expects algebraic decay. 
Moreover, from a finite-size scaling analysis of the spectrum one may find 
the dynamical exponent of the system. 

In this talk I will first show (Sec. 2) how reaction-diffusion systems of 
identical hard-core particles are related to a generalized Heisenberg chain. 
Its spectrum can be obtained from the Bethe ansatz. This will be a sim- 
plified rederivation of some results obtained earlier |nj. Then (Sec. 3) I will 
generalize the operator approach to the general reaction-diffusion problem 
of identical hard-core particles with nearest neighbour interaction in one di- 
mension. Finally I will return to the symmetric diffusion process and present 
a two-dimensional representation of the time-dependent operator algebra. 
I would like to emphasize that most of the results presented in Sec. 3 are 
original. 



2 Integrable Reaction-Diffusion Processes 

We will consider stochastic reaction-diffusion processes of identical particles 
with hard-core repulsion moving on a ring with L sites. Even though part 



of our approach generalizes to arbitrary lattices |16j we will study here only 
one-dimensional systems with nearest neighbour interaction. The stochastic 
variables of the system are the occupation numbers n = {nk} where nk — 0, 1 
indicates whether site 1 < k < L in the lattice is occupied or empty. At a 
given time t the state of the system is completely described by the probability 
distribution /(n; t). In this class of models there are ten possible reactions in 
addition to right and left hopping (diffusion), so altogether one has to specify 
12 independent rates > (Tab. 1). 

The stochastic dynamics are defined by the master equation 

jJimt) = E Hmn?)f(n/;t) - w(^;n)f( m t)\ (2) 

n' 

where the reaction-diffusion rates w(n;nf) for a change from configuration 
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Table 1: Bulk reaction and diffusion rates for nearest neighbour exclusion 
processes of identical particles. The numbers CLij £1X6 the rate of change of 
the occupation numbers {nk,n k+1 }. 



Process 


Rate 




Process 


Rate 




01 -> 10 


«32 


diffusion 


10 - 


-> 01 


«23 


diffusion 


11 -> 01 


024 


coagulation 


01 - 


-> 11 


«42 


decoagulation 


11 -> 10 


^34 


coagulation 


10 - 


-> 11 


^43 


decoagulation 


00 -> 01 


«21 


creation 


01 - 


-> 00 


0-12 


annihilation 


00 -> 10 




creation 


10 - 


-> 00 


0-13 


annihilation 


00 -> 11 


a 41 


pair creation 


11 - 


-> 00 


a 14 


pair annihilation 



n' — > n are equal to the sum 

L 

n fc'°^ n fc+i'° [ a21 ^ n fc>°^ rl fe+i' 1 ~^ a 31^n fc ,l^n. fe+ i,0 + a 41^n fc ,l^n fc+1 , 



fe=l 



Op' ndr,' 

On' \O n i n 

"fc' 1 "fc+i' u 

0m' 10m' 1 



n' fc ,0On' fc+1 ,l 



a 120"n fc ,0°"n fc+1 ,0 + a 32^n k ,l^n k+1 ,0 + a 420n fc ,lOn 



'fc+ii 



Ql3°n fc ,0°n fc+1 ,0 + a 23°n fc ,0°n fc+1 ,l + a 43°n fc ,l°~nfc+i,l 
Ol4^n fc ,0^n fc+1 ,0 + Q240n fc ,O0n fc+ i,l + 0340 nfe> iO nfc+ll o 



+ 

+ 
+ 

}■ 



This somewhat lengthy expression becomes more compact in the quantum 
Hamiltonian formalism ([I]): To each configuration n a vector | n) which, to- 
gether with the transposed vectors (n |, form an orthonormal basis of (C 2 )® L . 
In spin language this corresponds to a mapping to a spin 1/2 chain by identi- 
fying a vacancy (particle) at site k with spin up (down) at this site. The prob- 
ability distribution is then given by the state vector | f(t) ) = J2 n f(n', t) \ n) 
and the formal solution of the master equation (|]) in terms of the initial 
distribution | /(0) ) is given by | fit) ) = exp(— Ht) \ /(0) ). The stochastic 
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dynamics are defined by the master equation (TI|) with||16|| 

L 

H = Y.h k (3) 

fc=i 

where the matrices h k act non-trivially only on sites k, k + 1 and are given 
by 

I an a \2 a 13 a 14 ^ 

Q-21 a 22 °23 a 24 
0-31 0-32 0-33 a 34 
\ (Z41 042 CI43 044 / 



(4) 

k,k+l 



with Ojj- = — Et=i ay- 

The connection of if to the Heisenberg quantum chain becomes apparent 
by the similarity transformation H = ^VHV" 1 ^" 1 with V = exp(S" + ) where 
S + = Z)fc=i s fc an d s fc = (Cfc =t *°"fc)/^ are the s P m lowering an d raising 
operators acting on site /c and with $ = exp(£ E& fcot) where £ is a suitably 
chosen constant On the ten parameter submanifold defined by 

a 34 = a 21 + 0-41 + a 12 + ^32 — ^23 — a 43 ~ a 14 (5) 
a 24 = a 31 + a 41 + a 13 + a 23 — a 32 — a 42 — a 14- (6) 

the transition matrices have now the structure h k = h xxz + h k . Here h xxz 
commutes with S z = Efc=i °t/2 and /i^T is a sum of two parts which lower the 
^-component of the spin on sites k, k + 1 by one and two units respectively. 
So one finds 

H = H xxz + H (7) 

where H xxz is the Hamiltonian of the anisotropic Heisenberg ferromagnet 
with twisted boundary conditions in a magnetic field. The crucial observation 
is that H~ does not change the spectrum ofH xxz , since H xxz may be block- 
diagonalized into blocks with fixed quantum number S z and H connects 
only blocks of given S z with blocks with quantum numbers S z — 1 and S z — 2.0 
Quantities of interest are expectation values (i.e. r-point correlation func- 
tions) ( n kl (t) . . . n kr (t) ) fo = (s \n kl ■ ■ ■ n kr e~ Ht \ /(0) ) which give the proba- 
bility of finding particles on the set of sites {k\, . . . , k r } at time t, if the initial 
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This mechanism was first noticed in a similar context in Alcaraz et al.[E5| 
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distribution at time t = was /o- Here ( s\ — X) n (n| an d Uk = (1 — cr|)/2 
is the projector on states with a particle on site k. From the Bethe ansatz 
one finds now that the spectrum has an energy gap (i.e. inverse correlation 
time) // = 4a 4 i + 2(a 2 i + 031) + 012 + 043 — a 42 — a 43 > 0. If fi' — the 
dynamical exponent turns out to be z = 2. Note also that V transforms a 
r-point density correlation function into a matrix element in the sector with 
r down spins. Since H~ only creates down spins, only transformed initial 
states with I < r down spins will contribute to the correlation function. This 
surprising simplification allows for an exact calculation of the local average 
density for any initial state even though we are dealing with a non-trivial 



interacting many particle system[16 



3 The Dynamic Matrix Ansatz 

The results of the last section involve the constraints (|]), (|) and do not ap- 
ply e.g. for the asymmetric exclusion process. Also this model is integrable, 
but a calculation of time-dependent correlation functions has not yet been 
achieved. In order to solve this problem we now formulate a dynamic matrix 
ansatz for the general react ion- diffusion system defined by @ and (f|), gen- 
eralizing earlier work [I], |2|] for diffusion only. Instead of periodic boundary 
conditions we consider a system with open boundaries where particles are 
injected (absorbed) at site 1 with rate a (7) and at site L with rate 5 (/?). 
Therefore H = bi + bi + J2k=i with suitably chosen boundary matrices 

The ansatz is to take \f(t))= (( W \{Ilk=i(E(t) +D(t)a^)}\ Q)\V))/Z L 
where | 0) is the state with all spins up and D,E are time-dependent ma- 
trices satisfying an algebra obtained from the master equation (JI|). The 
(time-independent) vectors and \ V )) on which D and E act are 

determined from the boundary terms in the master equation and = 
((W \C L \V)) where C = D + E is a normalization. In this framework 
the r-point density correlation function is given by ( (t) . . . nk r (t) ) / = 
((W IC^DC^-^D . . . C L - kr \V))/Z L . Therefore, given a matrix repre- 
sentation of the algebra satisfied by D, E, the computation of time-dependent 
correlation functions is reduced to the much simpler calculation of matrix el- 
ements of a product of L matrices. 
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It is easy to see that (|1|) is solved if for each pair of sites one satisfies 
,1 d 



2dt 



+ h k )(E + D^)(E + D^ +1 )\0) 



(S + Ta k ){E + Da k+1 ) - (E + Da k )(S + Ta k+1 )\ | ) (8) 
where S, T are auxiliary operators satisfying 



((W\ 

,ld_ 
2di 



'~ + bi){E + D^) + (S + TaT)\0) 



+ b L )(E + Da I ;)-(S + Ta L )\0) 



V)) 




0. 



(9) 
(10) 



By comparing each of the four terms in (§D proportional to | ) , a k \0), 
a fc+1 |0) and cr k a k+1 \0) resp. one obtains four quadratic relations for the 
operators D,E,S,T. Eqs. ([|) and ([T0|) give two pairs of equations which 
define ((W \ and | V)). Introducing 



A 
B 
B 



(i) 

3 

(1) 

i 

(2) 



(2) 



(o 2 i + a 3 i + a 4 i)E 2 - a 12 ED - a i3 DE - a 14 D 2 
-a 2 \E 2 + (a i2 + a 32 + a i2 )ED - a 23 DE - a 2i D 2 
-a 31 E 2 - a 32 ED + (a 13 + a 23 + a 43 )DE - a 3A D 2 
—a 4 \E 2 — a 42 ED — a 43 DE + (a 14 + a 24 + a 34 )D 2 . 



one finds 



1 d 
2dt 



E 2 - [S, E] 



-—ED - SD + ET 

2dt 



1 d 
2~dt 



DE-TE + DS 

l±D 2 -[T, D] 
2dt [ ' J 



and 



((W\ 



1 d 
2~dt 



E-aE + ~?D + S 



(11) 
(12) 

(13) 

(14) 

(15) 
(16) 
(17) 
(18) 

(19) 
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-fD + T 



Sj\V)) 
A\V)) 
















(21) 



(20) 



(22) 



One may reduce this algebra by assuming that C is time-independent and 
has a representation where it is invertible. Eqs. (§) then imply [C, S + T] = 



and (|),(0) imply (( W \(S + T) = = (S + T)\V)). This can be solved 



by assuming S + T = 0, which, as I would like to stress, is not the most 
general choice. Now one can express S in terms of C and D and is left 
with only two further relations to be satisfied by D and C and two relations 
defining ((W\ and | V)). In particular, if @ and (^) are satisfied, there is 
one relation involving D which is linear in D and one relation quadratic in 
D. For the symmetric exclusion model a 2 3 = 032 = 1/2 this dynamic al- 
gebra yields eigenvalue equations for the corresponding XXX-Hamiltonian 
with integrable, but non-diagonal, symmetry breaking boundary fields]]], [J. 
However, no matrix representation has been found yet. This raises the ques- 
tion whether non-trivial representations do exist at all. 

As I will show here for the first time, the answer to this question is yes, at 
least with some restrictions on the injection and absorption rates. Choosing 
a basis where C is diagonal one finds the representation 



with e = (a + /3 + 7 + 6)/2, c=l-a-7 = (l-/3 - <J) -1 , d = a /(a + 
7 ) = 6/(P + 6) and ((W\, \V)) arbitrary but ((W\V)} ^ 0. In this 
representation A is an arbitrary parameter specifying the initial distribution. 
One may also use it for the construction of (right) eigenstates of H, since the 
expression (( W \E kl ~ 1 DE k2 ^ kl ^ 1 . . . E L ~ kr \ V)) is a superposition of wave 
functions ^f ei (k\, . . . , k r ) of eigenstates with eigenvalues e*. The argument is 
the position of r down spins on sites ki,...,k r . Taking A = corresponds 
to taking the stationary distribution as initial state. This is an eigenstate 
with energy 0. The terms proportional to A give the wave function for an 
eigenstate with energy e. The quantity 1/ (In |c|) plays the role of a spatial 
correlation length. 




(23) 
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4 Conclusions 

I have shown that a 10-parameter class of stochastic reaction-diffusion sys- 
tems can be mapped to a generalized Heisenberg quantum chain, the spec- 
trum of which can be obtained by the Bethe ansatz. It turns out that 
time-dependent r-point density correlation functions are given by the / < r- 
magnon sectors which allows for an explicit calculation of correlators. As 
an alternative to that approach a dynamic matrix ansatz was introduced 
for the general 12-parameter model. This ansatz reduces the calculation of 
all correlators to the calculation of certain matrix elements. These matrices 
satisfy an algebra which is determined by the bulk dynamics of the pro- 
cess. The boundary conditions determine which matrix elements one has to 
take. In the case of the symmetric exclusion process the algebra satisfied 
by the matrices can be used to obtain the spectrum of the corresponding 
quantum Hamiltonian which is the isotropic Heisenberg ferromagnet with 
non-diagonal boundary fields. An explicit time-dependent matrix represen- 
tation was presented here for the first time. From this one explicitly obtains 
all r-point density correlators for a one-parameter class of initial states. The 
corresponding eigenvectors of the Heisenberg chain are the ground state with 
energy and a bound state with energy e = (a + (3 + 7 + S)/2. 

The mapping in Sec. 2 relates a stochastic Hamiltonian to an integrable, 
non-stochastic Hamiltonian. It would be interesting to pursue this approach 
further and apply it to other systems. Two of the most important unanswered 
questions are (i) the relationship between the integrability of quantum chains 
and the dynamic matrix ansatz and (ii) the existence and construction of 
representations of the general reaction-diffusion algebra derived in Sec. 3. 
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